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DESIGN BY SPACE TRANSFORMATION FROM HIGH TO LOW DIMENSIONS 
Field of the Invention 

This Invention concerns design by spaoe transformation from high to low 
dimensions. More particularly but not exclusively, this invention concerns 
s methods and systems for design by transforming data from a high to low 
dimensional design space. 

Background of the Invention 

There are considerable cost benefits to be derived from improving designs 

1 .... V 

both by belter searches iri current design spaces and by satisfying more complex 
ip design cftteria, for instance by. striking the right balance between multiple , 
objectives from the same^dteGiplineW^ ■'• . 

In 'taiown design processes design t^jfeally spend a prohibitively long 
time preparing individual . analysis c^ses and, are constrained to sampling small 
areas of the! design space close to previously explored regions, in such a design 

15 processes, complex design tasks are broken down into manageable portions so 
that specialists in individual disciplines can resolve different parts of the design. 
However, such portions are too small and there Is too much iteration between 
disciplines which prohibits the challenging of the constraints of one discipline by 
another, where the most progress is likely to be made. Furthermore, known 

20 design space exploration techniques as applied to complex multi-dimensional 
design spaces are invariably inefficient on account of the associated high 
computational processing cost required for the data analysis. Also, such 
techniques can be problematic to use in complex multi-dimensional design 
spaces because these typically rely on simplistic data analysis models involving 

25 different parameters - for example* numerical errors or uncertainties associated 
with discretisation, incomplete convergence, irregular constraint boundaries can 
arise. The inventors have recognised that this situation can be ameliorated if 
small numbers of individuals can assimilate, appreciate and understand large 
amounts of data rapidly and efficiently. With this in mind, this inventive work is 

30 aimed directly at the designers in the design process of the future, who 
communicate with and steer the design search and optimisation process and who 
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can extract previous work from databases transparently and flexibly. They can 
use software and data as web services, so that the source of this data and 
software becomes unknown and unimportant Such designers make use of high 
cost analysis codes within automated search and response surface models to 
map and optimise domains using computationally expensive evaluations. They 
can use low fidelity (or computationally inexpensive) models to navigate high 
fidelity design spaces. The placement of analyses in the design space are 
defined by design of experiments (DoE) methods both as schemes defined a 
priori and as a result of optimisation or error-defining processes. These 
engineers, armed with more information and understanding, can be expected to 
regularly challenge cross-discipline; constraints. They are more concerned with 
problem definition, design space^sfiape add ^ optimisation than how any one 
analysis Is obtained and' rose al^ provide 
enhanced comprehension and effective nav&attebf ^ hype^imenslonal design 
spaces. :; : •. .>:V*f"* ' : " : V •" 

Objects and Summary of the Invention 

The present invention aims to overcome or at least substantially reduce 
some of the above mentioned drawbacks associated with known processes. 

It is an object of the present invention to provide a method and system 
which are reliable for providing enhanced comprehension and effective 
navigation of multi-dimensional design spaces. 

in broad terms, the present invention resides in the concept of 
transforming data from a high-dimensional to low-dimensional design space and, 
by inspecting the transformed data in the low-dimensional design space, enabling 
an optimum value for a functional representation of the transformed data to be 
established, and thereby permitting effective exploration of the high-dimensional 
design space. 

According to a first aspect of the present invention there is provided a 
method of transforming data from a high-dimensional to low-dimensional design 
space and deriving an optimum value for a predetermined function representative 
of the transformed data in the low-dimensional design space, which derivation is 

|010^2^^;6:^-:04;05W1 
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farther effected in the low-dimensional design space in dependence upon an 
inspection of the transformed data. 

According to a second aspect of the present invention there is provided a 
method of transforming data from a high-dimensional to low-dimensional design 
5 space, and deriving a conditional value for a predetermined function 
representative of the transformed data in the low-dimensional design s^^ v 
which derivation is further effected in the low-dimensional design space in 
dependence upon an inspection of the transformed data. 

It is to be understood here that the terms "optimum value" and "conditional 
10 value" herein are interchangeably used insofar as they are intended to 
correspond to the highest or lowest value of the functional representation of the 
. ? ,. transformed data in the low-dimensional design space, the particular various 
, ••if"'-':-!'*:- constraints to flie design space problem being further satisfied at the same time. 

' \ In acconJance with ah exemplary empodiment ©f the; invention \vhlch will 

15 be described frereafter in detail, the optimum/conditional value is derived by (a) 
establishing a mathematical combination of a number of independent design, 
variables and dependent design variables relating to the function, and (b)< 
modifying the combination in the low-dimensional design space to derives 
therefrom the desired value for the function at which various constraints 
20 associated with the function are satisfied and at which the function has a 
conditional high or low value in relation to other possible values of the function 
which are determined In accordance with the modification of said combination. 

Conveniently, the transformation into the low-dimensional design space is 
performed by application of a Generative Topographic Map (GTM) technique. It 
25 is to be appreciated that alternative transformation techniques, the self- 
organizing map (SOM) after Kohonen [13], or the Neuroscaie mapping (this is a 
physical distance preserving mapping technique), for example, could be used 
instead for this particular application. 

In accordance with another embodiment of the invention which wil! be 
30 described hereinafter in detail, the method comprises the step of transforming 
data from a first high-dimensional design space and from a second, different 
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high-dimensional design space info a low-dimensional design space, comparing 
the different transformed data sets in said low-dimensional design space and 
identifying therefrom similarities between the different transformed data sets to 
Indicate a correspondence between the first and second high-dimensional design 
5 spaces. This provides an effective way of assessing the importance and inter 
relationship of design variables in different high-dimensional design space 
problems. In this embodiment, to be described hereafter, the first high- 
dimensional design space is a 5-dlmenslonal design space, the second high- 
dimensional design space is an 8-dimensional design space, the third high- 
io dimensional design space is a 14-dimenstonai design space, and the low- 
dimensional design is a two-dimensional design space. It is to be appreciated, 
however, that various oftier kinds of high-dimensionality design space can be 
readily accommodated, if desired. 
• 5 " r . : "; : Advan tageously, fca data transformation into the tow^imenston^l :desi^n ' 
: r gpaoe is performed in a ihanner which tekes account^ the affect of each of the * • 

design, variables relating to the function. This makes optional the need for any ^ 

' pre-screeriingof the design variables. 

Optionally, the optimum/conditionai value derivation is effected by 
generating an image map representation of the transformed data in the low- 
20 dimensional design space (for example, a 2-D image map representation may be 
generated), and visually Identifying an intersecting region in the image map 
representation, which Intersecting region provides an indication of said value. It 
is to be understood that the identification step could be performed 
computationally, if desired, so as to provide the required technical effect 
25 The invention has utility for aircraft design applications and although this 

technology has been developed with reference to aircraft aerodynamic design in 
particular, the design space visualization and curve fitting technology developed 
is general. It should therefore be equally applicable to other disciplines such as 
cost analysis, structures and computational electromagnetics, in which expensive 
30 analysis tools are used to find optima for complicated design problems, it is 
expected to be particularly useful in multi-disciplinary design and situations where 
there are multiple optima in the design space. 
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It is to be appreciated that the present Invention may be embodied in software. 
Accordingly* the present invention extends to a computer program element 
comprising program cod© for configuring a programmable device apparatus or 
system to implement the above described method. Suitably, the computer 
program is stored on a carrier medium. 

Further, the present invention extends to a data processing system or 
apparatus for transforming data from a high-dimensional to lovwiimensfonal 
design space adapted and arranged to implement the above described method. 

The above and further features of the invention are set forth with 
particularity In the appended claims and will be described hereinafter with 
reference to the accompanying drawings. 

Brief Description of the Drawings 

>i;Flgure 1 shows a schematic representation of an RSM-Based Design- 
# Process; 

IS; . Figure 2 shows an image representative of a design space, for an 
: ;t. analytical function; 

Figure 3 shows a series of conventional scatter plots; 

Figure 4 shows a set of self-organising maps for a 2-D analytical problem; 

Figure 5 shows an alternative image representation of the image of Figure 

20 2; 

Figure 6 shows the typical result of transforming the image representation 
of Figure 5 Into a triangle; 

Figure 7 shows the typical result of transforming the image representation 
of Figure 5 into an SOM; 

25 Figure 8 shows the typical result of transforming the image representation 

of Figure 6 into a GTM; 

Figure 9 shows the typical result of a 50 x 50 evaluation of a 2-D design 
space using a 2-D panel method; 

Figure 1 0 shows a series of scatter plots for a 5-D military aircraft problem; 
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Flgure 11 shows a set of self-organising maps for a 5-D military aircraft 
problem; 

Figure 12 shows a ©-dimensional Hierarchical Axes Technique plot; 
Table 1 shows a typical set of results for design space optimisation as 
obtained form the Kriging Process; 

Table 2 shows a set of results corresponding to Figure 13 for design 
space optimisation, as obtained from OTM optimisation for a 5-D problem; 

Figure 13 shows an image map representation af transformed data in 2-D 
design space, in accordance with an embodiment of the invention; 

Figure 14 shows a loading distribution plot of optimised wing design 
corresponding to an inventive application of an embodiment of the present 
'invention; * 

Figure 15 shows an image map representation of transformed data In 2-D 
.deslgi* space, as obtained from GTM transformation of an 8-D aercfiynamic , , 
is problem; 

' Figure 1 6 shows another Image map representation of transformed data in 
2-D design space, as obtained from GTM transformation of a 14D aerodynamic 
problem; 

Figure 17 shows a Hierarchical Axes Technique (HAT) plot of the 6D 
20 Hartmann function; 

Figure 18 shows another image map representation of transformed data, 
as obtained from a 2D GTM transformation of the 6D Hartmann function; 

Figure 19 shows another image map representation of transformed data, 
as obtained from a 4D GTM transformation of the 6D Hartmann function; 
25 Figure 20 shows another image map representation of transformed data, 

as obtained from 4D GTM transformation of the 14D aircraft problem; and 

Figure 21 shows how points on a regular grid in low-dimensional space 
are mapped using a non- linear mapping to corresponding centres of Gaussians. 

Detailed Description of Exemplary Embodiments 
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This invention is to be described in the following way. The 
application of visualisation and design space transformation on a two- 
dimensional analytical problem is described and then extended for use In military 
aircraft design. A two dimensional visualisation of a representative military aircraft 

5 problem is described and then extended to 6, 8 and 14 dimensions. The 
description includes a specification of the optimisation problems and a modus 
operandi for a design process is introduced. The visualisation is compared to 
alternative techniques, such as scatter plots and SOM visualisations. Possible 
applications of the different visualisation methods, in conjunction with response 
10 surface method technology, are also described. The proposed inventive process 
whereby the transformed design space is then used to obtain the optimum In the 
design space is explained. The proposed process and usual process are 
compared for the 5-D problem. It is shown how by implementing ttie proposed 
process the solving and understanding of multi-dimensional design spaces can 

15 be effectively performed in a %ordimensional image. 

Modus Qperafldi 

It is to be appreciated that the large amounts of data required for 
design space appreciation can be provided by response surface method 
technology. Visualisation is part of a modus operandi as shown in Figure 1. This ■< 

20 comprises first, a problem specification, in terms of objectives, constraints and 
design variables. Then a DoE (e.g. Latin Hypercube I3], LP t [4]) is performed and 
a response surface methodology applied (for instance kriging, radial basis 
functions [5,6,7], etc). An update strategy is then determined by statistical 
methods, such as expected improvement or the optimum in the domain based on 

25 the visual inspection of maps. As part of this process an assessment takes place 
as to the importance of the design variables in the problem. The inventors have 
found that the first visualisation method proposed ceases to work after about 6 
dimensions. The inventors propose to transform the spaces described from high 
dimensions (5, 8 or 14-D in this case) to just two or four dimensions by use of the 

3Q generative topographic map (GTM) (although the exact dimensionaiity of the low 
dimensional transform is optional). 
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As previously mentioned, the invention is described hereinafter by use of 
two example problems. First, a simple two-dimensional analytical problem, from 
Schwefet's book [1] as described. Secondly, a military aircraft optimisation m 2, 5, 
8 and 14 dimensions is described. More conventional design space appreciation 
5 and response surface fitting methodology is also described. 

Analytical Problem Specification 

A two-dimensional analytical function ie chosen so that fall appreciation of 
the design space and comparison with the transformations is possible. It is 
assumed that if transformations are poor in two-dimensions then their application 
10 in higher dimensions will be even worse. 

The analytical problem is shown in Figure 2 where the objective function 
(Ob) and the constraints (C 4 to C 7 ) are defined as: 

4*(X) = y ..." • V 

C, (*)=-*, 

C s (x) = - x*.*t7.6x& S.Oxt -66.0 
C 5 (x)=-*, s -X/+4-0*, *14.0* 1 -«.0 

In this definition, a constraint is considered satisfied if it is so.o. The 
15 objective function is not drawn in the domain where any of the constraints are 
violated. The traces show all the evaluations made using an SQP optimisation 
method from multiple starts along the line *,=3.o The SQP method used was by 
Madsen [1] and based on the Harwell Library Subroutine VE02AD. Alternative 
starts, for example along the*, -co line also find the optimum at [0.5]. The 
20 problem lies in being able to extend plots like this to multiple dimensions. 

The results achieved for this optimisation depend on which constraints are 
active when the problem is solved. The four possible local minima occur where 
the constraint boundaries intersect 

• x =(0,5), OH*) - -25, constraints J and 5 active; 

x = (2.116,4.174), Ob(x) w -21.90, constraints 4 end 5 active; 

• x = (5,2), Ob{x) => -29j constraints 3 and 4 «*i ve; 

• and x = (6, 0),£MKjO = -3o\ constraints 2 and 3 active. 
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The global optimum, the optimum of all the local optima, is at 

x = (6, OX Ob(x) -36, with constraints 2 dwJ 3 active 

A good SQP algorithm would be one which would find all the local optima 
at intersections of the constraint boundaries and then the designer would inspect 
5 these and find the best answer from them. At this point he may also wish to take 
additional considerations into account 

Additional plots can be used to further interrogate the data. First a series 
of scatter plots can be drawn as shown in Figure 3, in which every item of date 

10 can be plotted against every other item of data that Is, of every dependent and 
independent variable of interest against every other variable. Scatter plots are 
widely used by the statistics community, see for example [10]. These plots 
enable a good appreciation of the design space and to establish whether or not 
known trends are being followed. This process confirms for instance the nature of " 

15 the design of experiments (DoE). Here, deWign Variable 1 and design variable 2 
are chosen at every corner point of a mesh, which subdivides the design space 
equally: The quadratic rtature of the constraints is also discernible. Alternatives to 
this include parallel co-ordinates [11, 12] or SOM's)- These latter methods also 
enable relationships between variables to be obtained [14] and, possibly, to 

20 establish the most important variables in the problem. 

Figure 4 shows a set of SOM's for this data- The directions of and x* 
are horizontal and vertical respectively, showing that they are orthogonal in the 
design space. The objective {*x*-Xz) is monotonicaliy related to c* as the 
diagonal lines go in the same directions and the colour changes from bottom left 
26 to top right. x t and c* are shown to be inversely related as the colours are in the 
opposite directions, but still horizontal in both maps. Similarly Is inversely 
related to The functions c* t c & and the objective are all circular. (See U.K. 
patent application No. 0228751.4). 

Although the SOM appears to be able to detect relationships between 
30 functions it does not fecilftate the scrutiny of play off between domain constraints. 
In addition the location of function minima, is also desirable, along with tracking 
the paths of optimisations. These properties can all be Identified, for a 2- 
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. dimensional problem in Figure 2. An alternative representation of Figure 2 is 
shown in Figure 5. Note that in the Figure the feasible region is denoted by the 
white circles and the infeasible by the black circles. The lull extent of the 
constraints is also shown. Thus, the complete domain is shaded and the feasible 
5 and infeasible regions are determined by the colour of the circles. The circles 
represent the DoE and are drawn for every other point in the design space- The 
complete extent of the constraints is shown. This representation follows the 
annotation of Grossman et al [16], in which a 28 dimensional space is 
represented as a triangle. The triangle in [16] is a mapping of 28 dimensional 
10 vectors into 2-D, 3 points are chosen to form the corners of the triangle. These 
may be local optima or perhaps two local optima and one intermediate point. AH 
the intermediate points are then obtained as being a certain distance away from 
these reference points. The actual objective and constraints are then plotted as 
usual in a 2-D plot. A fourth reference point would then be^required to turn the 2- . 
is D representation into a solid object. This technique necessarily incurs a loss in ^ • 
data 'structure, and a triangle is al' relatively complicated mapping, particularly in 
higher dimensions. To understand the limitations of this method this mapping is 
presented for the circular function in Figure 6. and can be compared directly with , 
Figure 5, except that the extent of the colour map is reduced in the triangular 
20 representation. Additional points outside the triangle could also be obtained by 
extrapolation. Note that in Figure 6 the optima at x=[6,0], x=[5,2] and 
x=[2.1 16,4.174] form the comers. Intermediate points are obtained by 
interpolation. Although this transformation could provide some appreciation of a 
high dimensional space the problem with it is that the space extent is unknown. 
25 As such it can be used to appreciate space around known points in the domain, 
but whether all the optima are captured or the required amount of space has 
been visualised is not known. . 

A transform is required which has a better 2-D manifold. The SOM is a 
projection and visualisation of a high-dimensional signal space on a two- 
30 dimensional display. Therefore it should be possible to use the SOM rather than 
a triangle for the 2-D manifold. Returning to the SOM it is clear that the 
tessellated hexagons used previously are relatively coarse. In fact, a much finer, 
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rectangular definition is possible. The equivalent SOM to Figure 5 is next shown 
in Rgure 7. However, the SOM is found not to give very good results and the 
mapping from topographic space to the data space is only defined at the location 
of the nodes. 

5 The Generative Topological Mapping (GTM) is intended as an alternative 

computation of the SOM, in an attempt to define the metric relations between the 
models on the map grid with improved fidelity to those in the data space. The 
trade-off is a higher computational cost. The equivalent GTM to Figure 5 is 
shown in Figure 8. The orientation of these maps is always somewhat arbitrary, 
10 so rotation through 90 degrees anticlockwise shows a very similar representation 
compared to Figure 5. This transformation will now be applied to a military aircraft 
design problem. 

Military Aircraft Design Problem Specification 

• i~ t . The problem is to minimise the drag coefficient (C D ) of a representative? 

; ,p, 15 Military Aircraft trapezoidal body/wing taxless aircraft in cruise 'at M=0*5<. 
subject to: "'■ 

S-D Problem: : i 

V 

•3.0 < wing linear twist (washout, 6) £ 7.0 

-3.0 £*mg angle of attack («) 5 7.0 

0.0S mitt-camber £0.07 

0.0 £ fop deflection angle (£) < 1 0.0 

9,557 £ leading edge Hp locate* £ I4.2Z7 

C mtatdl = + hC L costs + fiCj, sin cr 



20 
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S-D Problem; 

♦Q.QI < Root Camber at 30%c £ 0.025 
•0.0 1 £ fcooc Camber at #ft£c s 0.04 
•0.01 £ 50% Semi-span Camber at 30%? 5 0.025 
-0.01 £ 50% Semi-span Camber at 60%c * 0-04 
.0.0 1 £ Tip Camber at 30%^ £ 0.025 
-0,0 t £ Tip Camber at tf)%c £ 0.04 
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or s a ^ 7* 

subject to the constraints; 
O>0.i9»4 ami |CJ<0.02 

144) Problem: 

-0.01 £ Centre line Camber at 20%c £ 0-02 
-0.01 < Centre Kit* Camber at 40%? £ 0.03 
-4.01 £ Centre line Camber at 70%c S 0-03 
-0.01 S 40% semi-span Camber at 20%c < 0,02 
-0.03 £ *0«> semi-span Camber at 4Q%"G £ 0.03 
-0.01 £ 40% semi "Span Camber at 70%? £ 0.03 
-0.01 £ 70% semi -span Camber at 20%c £ 0.02 
-0.01 <70% semi-span Camber at 40Voc £ 0.03 
-0.0 1 < 70% send-span Camber at 70%c £ 0-03 
-0.01 5 Tip Camber at S0%? £ 0.02 
-g T 01 3 Tip Camber at 50%?£0.<B 
-0.01 & Tip Camber at $0V°c & 0.03 

r £ tf ^ r 

subject to the constraints: ... 
C^>0.1Wand|C>0,02 



where C L is flic lift coefficient and C„ the pitching moment coefficient 



CFD evaluations are performed using the BAE SYSTEMS in-house code 
FUTE3D [8] In inviscid, Euler mode. 

Visualisation 

10 Figure 9 shows a visualisation of a related two-dimensional design space, 

with computational noise and felled evaluations. (Here, a simpler solver Is used 
with two trailing edge parameters to reduce the computational cost so that a large 
number of evaluations Is possible-) This corresponds to 50x50 evaluations of a 
two-dimensional design space (C D at C L =a7f, M=0.74) using a 2-D panel 

15 method. The two-dimensional design space describes the vertical movement of 
two B«spline poles adjacent to the trailing edge of an aerofoil. Computational 
noise often causes ridges in the design space, see also, far instance [9]- It is 
clear that gradient searches in this domain will not find the global optimum, but a 
local one, stopping at the bottom of a ridge. These problems are likely to be 
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amplified in higher dimensional space, inability to visualise high dimensional 
spaces can lead to an inability to fully exploit the additional flexibility. 
Computational noise and expensive evaluation naturally leads to the use of 
response surface methodologies in design space optimisation. 

5 Figure 10 shows the scatter plots for the 5-D military aircraft problem. In 

these, for instance, the quadratic nature of the relationship between C L and Co of 
every dependent and independent variable in the 5-D problem against every 
other variable can easily be identified. Additionally the independent variables 
show no relation with each other as should be expected given the DoE used to 
10 collect the data. 

Figure 11 shows & sat of SOM's for the 5-D military aircraft problem. To 
orient oneself with the SOM's it is necessary first to look at the picture of the 
glyphs shown top right. In this image, each of the glyphs is placed according to 
the value of a, Gend S and?are coloured according to the value of C L . The SOM ! 

.15 is a diagrammatic representation rather than a physical map of the design space, 

'.j as illustrated by comparison between the SOM of C L and toe glyph image: the 
trends of the data are the same and have similar features. Consider the Ct SOM 
tie, it varies from red through green to purple across the diagonal. In the glyph ' 
image, the same variation can be seen from top left to bottom right. In the SOM's 

20 the diagonal trends of the maps of C 0 , C u Cm trim and a show that they are all 
related <Ct>, Ct, armonotonicaily and inversely to C rt and trim). The SOM's also 
show that the independent variables in the problem are unrelated, as they should 
be, given a suitable DoE. In higher dimensional problems, the SOM has been 
shown to indicate the first two principal components, as their SOM's can be 

26 related although in opposite directions (e.g. in opposite diagonal directions or 
vertically and horizontally). Bland regions in the SOM give an indication of rogue 
data (e,g. from unconverged CFD evaluations) and completely bland SOM's can 
help to identify unimportant variables. 

Figure 10 and Figure 1 1 are not easy to interpret, and the next question is 
30 whether or not the type of visualisation presented in Figure 2 can be extended to 
higher dimensions to provide equally useful information. 200 CFD evaluations 
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were used to obtain the Krlg. Figure 12 shows a hierarchical axes technique 
(HAT) plot after [15} noting that filled squares denote optima located in the model 
using different optimisation methods. The other squares show the locations of 
evaluations in the final stages of simulated annealing of the response surface. 
5 The value of C D is coloured within the tile. Colouring does not take place if the 
inequality constraint on C L is violated. The contour lines are contours of trim 
constraint. As shown in the Figure, within an individual tile camber and 6 vary. 
As one goes from tile to tile in the horizontal direction of the main plot & varies 
and in the vertical direction evades. Then the top 81 tiles of this image represent 
10 the highest value of the fifth design variable, leading edge tip location. Each block 
of 81 tiles going down then represent lowering values of leading edge tip location. 
Only the top of this image is presented so that the smaller tiles are seen clearly. 
Two optima are shown: the first the result of a simulated annealing optimisation 
, (red square) and the second toe .result of an exhaustive search, in the 
■15 representation data.' This visualisation is similar in spirit to the triangle^ used in 
; v . Figure 6 and [16], but with a less complex design space transformation, the HAT 
.. plot 'can however, only be used for data appreciation in up to 6 dimensions, as\ 
the" tiles become too small thereafter. This picture is only possible because 
response surface methodologies enable the large amount of data required for 
20 plotting to be provided. The image gives confidence that the same optimum is 
being located in both cases and that the curve fit is well behaved. 
R*sM |ts from the RSM K riaino Process 

To validate the RSM Kriging procedure some results from this process are 
given in Table 1. The variation in the results given in Table 1 could be cause for 
25 concern, except that reference to the visualisation shows that these results are 
close to each other and are therefore close to the same optimum. The CFD result 
is significantly different from the RSWl, which means that there is mileage in 
building a new model, including this optimum and iterating until the optimum and 
CFD result obtained converge. The loading distribution and geometry of the final 
30 configuration are shown in Figure 14. In this case the loading distribution is 
neariy elliptic, as required, except for the compensation for wave drag in the 
outboard wing. The sweep is reduced compared to the initial configuration as 
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large amounts of sweep give a large amount of downward pitching moment 
which has been reduced. During a large number of optimisations of similar 
design spaces, In general there seem to be two optima in these design spaces. 
The second is an optimum in which the result is below the elliptic loading 
distribution at the root and above it at the tip. This has a deleterious effect on root 
bending moment (Ae. increases it) and hence the structural optimum is worse 
and so in general the aerodynamics community chooses the answer presented 
here. 

The GTM in the 5-0 problem 

Instead of Kriging the three design parameters of interest separately, in 
the SOM and GTM all the parameters of interest the design variables, the 
objective and the constraints ana transformed into the tower dimensional space 
y(x,W)- The thesis in which the GTM is developed (18] offers the visualisations 
posterior fnean and mode projection, the responsibilities and the magnification 
15 factors. This latter plot is a single image representing y(x,W). However, Instead 
the inventors use the individual components of the vector y(x,W) pertaining to the / 
variables of interest in the problem. Fronrv these components the penalty function 
can be obtained and plotted, with contours of C L arid trim, where p(x) Is given 
by: ■ 

Where o are MacCauiey brackets, in which the contents become zero if 
the function therein is negative, else the value of the function is used. 

Figure 13 shows an image map representation of transformed data in 2-D 
latent design space y (x,w) in accordance with an embodiment of the invention. 
25 More particularly, this image map representation is provided by application of the 
GTM transformation for the 5-D aircraft design problem. Not^ that the penalty 
function is shown in the Figure, obtained from a combination of latent spaces for 
C Lf Co and C my wrth contours of the latent spaces of C L and trim. The cross 
marks the optimum, that is the point where Cp is the lowest and both Cl and trim 
30 are satisfied. Here, a 60x«o latent space of tsxis radial basis function (RBF) 
■ centres was used. Transformation back into real space gives the corresponding 



-16- 

values of x 1t x* X3, x» and Xs. These results are given in Table 2. The agreement 
between the CFD and GTM Is excellent and the result is better than the 
preliminary result obtained using Krigfng. Comparison between the GTM and 
Kriging results Is also shown in Figure 14. This Figure shows a loading 
distribution of optimised wing design using kriging and the 5-D inventive GTM in 
accordance with an embodiment of the invention. Also shown are the starting 
and final CFD models. The GTM result is. better as it is closer to an elliptic 
loading distribution. The new point could also now be used to build a new GTM, if 
desired, as the optimum could be used to build a new Krig model. 

Use of the GTM for high er dimensional optimisation 

The GTM was also used to optimise aerodynamic design spaces in 8 and 
14 dimensions. In both cases a. eoxeolatent space was used with 30x30 RBF 
centres. The visualisations are shown in Figure 15 and Figure 16 respectively. 
Note that Figure 15 is shown orientated in such a way to show similarity to the 
14-D GTM shown in Figure 16. The solution to the 8-D problem is at xi= 0.05058, 
y 2 = o,01256 r jf3= 0.005531, X 4 ~ 0.00668, XjF 0;0O953 f *«F -0.00360, xf* 4.8462, 
xg= 1.7266, with the GTM model after a number of iterations and the CFD 
solution being C L - 0.2022, C 0 = 58.83 counts, C m = 4.06359661. This is 
probably reasonable compared to other optimisations, for instance a 3-D gradient 
search also gave Co= 58.8 counts, with 0*0.1994 and C^-O.OZ (higher C L and 
lower C m in this case), although there is probably more to come as the GTM 
solution is not on the boundary. This could possibly be found using a gradient 
search. The GTM in conjunction with an optimisation method does not seem to 
work as well in 14-D as in lower dimensions. It is probable that this is because 
the transformation is doing more 1.9. going from 14-D to 2-D. To ameliorate this it 
should be possible for higher dimensions to transform to 4-D and view using the 
HAT plot discussed previously. The distinct similarities between Figure 15 and 
Figure 16 are evident and significant because they show that the same problem 
is being solved in both cases. It may assist in the future when trying to ascertain 
whether or not more limited sets of design variables can be used to adequately 
represent problems to compare the 2-D design spaces of both the lower and 
higher dimensional representations of the problem. 
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Figure 17 shows a Hierarchical Axes Technique (HAT) plot of the 6D 
Hartmann function [Dixon and Szego [21]]. This function is a multimodal function 
with two identifiable local optima. As shown in the Figure, the 4D GTM 
transformation can be used to obtain an improved optimum over the 2D GTM 
$ transformation. Note that the 2D GTM and 4D GTM results are represented by 
circles and diamonds, respectively. 

Figure 18 shows another image map representation of transformed data, 
as obtained from a 2D GTM transformation of the 6D Hartmann function. As 
shown, the optima are represented by triangle symbols. Note that the triangle 
10 symbols correspond to the 2D GTM circles as shown in the HAT plot of Figure 
17. 

Figure 19 shows another image map representation of transformed date, 
as obtained from a 40 GTM transformation of the 6D Hartmann function. As 
f : shown, the optima are represented by trjangle pymbols. Note that the,triangle * 
i5 ; symbols correspond to the 4D GTM diamond symbols as shown in the HAT plot 
? of Figure 17. The advantage here is that, more information can be retained, 
because the transformation stepjn, going from 6D design space to 4D design 
space is less than that in going from BD design space to 2D design space. 

Figure 20 shows yet another image map representation of transformed: 
20 data, as obtained from 4D GTM transformation of the 14D aircraft problem. As 
shown , the optimum is marked by a white square symbol. 

Other Potential Applications of the GTM in Design 

During the kriging process it is possible to merge high and low fidelity data 
results. Plots of such data would show similarities and differences in the GTM. 

25 Previous work has considered the use of the GTM in design space search, 

see [19J. However, here the SOM and GTM are used to predict how a low fidelity 
model relates to a high fidelity analysis. This inventive work does not consider the 
optimisation process per se in the lower dimensional representation. In [19] El- 
Beltagy indicates that the GTM algorithm can also be used as a visualisation tool 

30 to understand the discrepancies between the models and so reformulate the 
optimisation problem, although he does not show how. 
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Conclusions 

A 2-dimensional plot generally provides the best data visualisation. 
Multiple dimension data needs to be transformed to lower dimensions to enable 
this. The HAT plot visualisation along with the RSM technology enables 

5 visualisation in up to 6 dimensions. The GTM has been shown to provide 
adequate visualisation and a quantitative graphical method for optimisation up to 
14 dimensions. However, the step from 14-D to 2-D may be too large and 
therefore a 4-D GTM may be more accurate. More points in the 14D RBF and 
latent space may also improve the GTM. 

10 Visualisation technology helps the designer to spend time inspecting 

results and ensuring correctness rather than dealing with large volumes of flow 
data. After a large number of numerical evaluations have been performed there is 
a need to Identify any off trend results. The scatter plot method presented here is 
.ideal/for this purpose. The SOM also helps with; this to give an overview. , 

15 : Response surface method technology eliminates ^inefficient design space • 
sampling in the final stages of a gradientv search optimisation. A balance is , ; 
required between the number evaluations in the DoE„ the number of cycles in the ; 
CFCC the number of points in the initial- DoE and the number of further 
evaluations used. The trade-off between low-dimensional comprehension and 

20 high-dimensional accuracy impacts optimisation. 

These type of visualisation methodologies are utilised to support design 
decisions such as the relative scaling of the design variables and constraints and 
choice of penalty function, which are important in optimisation. Also possible is 
the recognition of problems such as numerical noise and boundaries of 

25 evaluation failure. Initial design of experiments can be improved in a systematic 
way by calculation of additional points dictated by maps of statistical and other 
error criteria. Significantly, the Invention has utility for various aircraft design 
applications. Also, the invention can be embodied in software, if desired. 
Although this technology has been developed with reference to aircraft 

30 aerodynamic design In particular, the design space visualisation and curve-fitting 
technology developed Is general. It should therefore be equally applicable to 
other disciplines such as cost analysis, structures and computational 
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electromagnetics, in which expensive analysts tools are used to find optima for 
complicated design problems. It is expected to be particularly useful in multi- 
disciplinary design and situations where there are multiple optima in the design 



& Having thus described the present invention by reference to several 

preferred embodiments, it is to be appreciated that the embodiments are in all 
respects exemplary and that modifications and variations are possible without 
departure from the spirit and scope of the invention. For example, whilst in the 
described embodiments the transformed data in the low-dimensional (2-D) image 
ia map representations are visually inspected, it is equally possible for the 
inspection to be performed computationally, it is to be also understood that the 
described inventive transformation technique can be effectively applied to a wide 
range of high-dimensionality design spaces and that the transformation of data 
. i.. , can be suitably performed into any one of a wide range of low-dimensionality* 
» T; 15 design spaces. .] 

• ; : ' • •' ' ' It is to pe also appreciated that whM the GTM ^transformation technique is 

applied in the described exemplary embodiments, t&ps equally possible to use 
'alternative transformation techniques, SOM or Neuroscale for example. Instead 
of GTM, so as to realise the Inventive technical effect 

20 
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Appendix 1 Krialna 

Here, a Kfiging approximation using a Gaussian kernel has been used to 
perform the RSM surface fits, see for Instance in Sacks [5] or Jones [6,7]- tf y is 

an (nx1) vector of responses evaluated at the locations X t , p=1,~.,n, where n is 

5 the size of the DoE, then the response at the unsampled points x* is an 
estimate given by; 

where: 

1 is the vector of ones and J* is a weighted mean given by: 

iTn-l. 



with:.. , 

1* being a correlation vector based on the measured and estimated 
sample points, X * , 

R is a matrix of correlation coefficients, based on the *' data points 

15 the (*,/)* entry of Ris given by C° rr l x i> x j] and tne I* element of 

C^ir[x fs ^3 = exp[-£l0^jx w -x ft/ | ] & t >QJ = 1,...,* 
for a sample of k variables at H points. 

The hyperparametere pn and the factor on w^n in SVD (if used) are 
20 optimised by maximising the likelihood function or minimising: 
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2 



Where the variance, <7" 2 , is given by: 

. fy-ifl/R-(y-iii) 



n 



Giving the mean square error of the predictor as: 

, a-i T R-'D' 



j 2 (x*) = cr 2 



Finally, the expected improvement is given by: 



\y«m -^g ^--"* 1 "^) ' s^ 3 ^"^) if the constraints are satisfied 
n else 



Here, is defined as the minimum of the input data, which satisfies the 
constraints.' When considering minimisation, Expected Improvement can have its 
id maximum value where the data is sparse or the approximation has a low value. 
The strategy is to resample where the Expected Improvement is maximised, then 
to form a new approximation and repeat 

Where the standard normal density and normal distribution functions are: 



X 2 x 



i 

e 2 du 



-Jin 



15 



If the Euclidean norm te given by H"» ,inear and Mn plate spUne IBdW 
basis functions are given as: 

Corr[ Xi ,Xj] = \\4 



C W [^,^]-||zflog(|H|) 
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These Equations do not provide kernels suitable for tuning or error 
analysis with statistical interpretation, it should be noted that alternative kriging 
algorithms are also widely used, which use the variogram instead of the 
correlation, see for example [17]. 

s Appendix 2: Summary of the GTM algorithm 

The GTM is a non-linear parametric mapping y(x,W) from an L-dimensional 
latent space to a D dimensional data space, where normally, L<D. as illustrated 
in Figure 21. The sequence of steps for constructing a GTM model is given in 
[18] as; 

10 Generate the grid of latent points; 

{*,}, * = 1,...^-. 

Generate the grid of basis function centres; {/* m } , X& — 1, . . ♦ ,M . 

Select the basis function width <x ^ 
1 Compute the majtrlx of basis function activations, 

Initialise W, randomly or using PCA. 
15 Initialise/?. 

If desired, select a value for cl 

't 

Compute A, A Aw = |K~«>*W|]\ 
Repeat . 

Compute R using A and fi. 
Compute G using R. 

W = (<B T G<& + 1Xf x O t RT, where A may be zero. 

Compute A> A to = \\tn~^k W f j>M-step 
Update ft, using R and A. 



' E-step 



20 



Until convergence 



c 
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The squared distances required to update p in the M-step gets 'reused' 
when calculating the responsibilities in the following E-step. In our case we use 
the implementation of this formulation by Ian Nabney of Aston University in 
Netlab, [20]. 
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CLMMS 

1 . , A method of transforming data from a high-dimensional to tow-dimensional 
design space and deriving an optimum value for a predetermined function 
representative of the transformed data in the tow-dimensional design 
$ space, which derivation is further effected in the low-dimensional design 

space in dependence upon an inspection of the transformed data. 

2. A method of transforming data from a high-dimensional to tow-dimensional 
design space, and deriving a conditional value for a predetermined 
function representative of the transformed date in tine low-dimensional 

10 design space, which derivation is further effected in the low-dimensional 

design space in dependence upon an inspection of the transformed data. 

3. A method as claimed in daim 1 or 2 wherein the value is derived by (a) 
establishing a mathematical combination of a number of independent 
design variables and dependent design variables relating to the function, 

15 and (b) modifying said combination in the tow-dimensionaf design space to 

derive iherefram the desired value for the function at which various 
constraints associated with the function are satisfied and at which the 
function has a conditional high or low value in relation to other possible 
values of the function which are determined in accordance with the 

20 modification of said combination. 

4. A method as claimed in claim 1, 2 or claim 3 wherein said transformation 
into the tow-dimensional design space is performed by application of a 
Generative Topographic Map (GTM) technique. 

5. A method as claimed in any preceding claim, comprising the step of 
25 transforming data from a first high-dimensional design space and from a 

second, different high-dimensional design space into a low-dimensionai 
design space, comparing the different transformed data sets in said low- 
dimensionai design space and identifying therefrom similarities between 
the different transformed data sets to indicate a correspondence between 
30 the first and second high-dimensional design spaces. 
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6. A method as claimed In claim 5 wherein the first high-dhnensiona] design 
space is a 5-dimensional design space, the second high-dimenslonal 
design space is an 8»dimensional design space, the third is a 14- 
dimensional design space, and the iow-dimensional design space is a two- 

5 dimensional design space. 

7. A method as claimed in any of claims 3 to 6 wherein the data 
transformation into the low-dimensional design space is performed in a 
manner which takes account of the effect of each of the design variables 
relating to the function. 

10 8. A method as claimed in any preceding claim wherein the value derivation 
is effected by generating an image map representation of the transformed 
date in the low-dimensional design space, and visually identifying an 
intersecting region in the image map representation, which intersecting 
region provides an indication of said value. .{" 

is A method as claimed in any preceding claim for application to an aircraft 

design or to an aerodynamic surface design. 

10, A method substantially as herein described with reference to the 
accompanying drawings. 

11. A program element comprising program code operable to carry out a 
20 method as claimed in any preceding claim, 

1 2, The program element of claim 1 1 on a carrier medium. 

13. A data processing system for transforming data from a high-dimensional to 
low-dimensional design space adapted and arranged to carry out a 
method as claimed in any preceding claim. 

25 14- A data processing system substantially as herein described with reference 
to the accompanying drawings. 




|D10l:?ie0^^p^jD[4.v05.^f71 



iG-flPR-2004 ..1?«BT FROM Intel lectual Prop TO GB PAT OFFICE • P. 3 

■%■ ' ■ . ' • 

-29- 

ABSTRACT OF THE DISCLOSURE 

DESIGN BY SPACE TRANSFORMATION 

FROM HIGH TO LOW DIMENSIONS 

A method is provided for transforming data from a high-dimensional to 
S low-dimensional design space, and for inspecting the transformed data In such a 
manner as to permit effective navigation and exploration of the bigh-dimenslonal 
design space. Conveniently, an optimum/conditional value for a preserved 
functional representation of the transformed data can be derived by visual 
inspection of a 2-D image map representation of the transformed data. 

10 Significantly, the invention has utility for various aircraft design 

applications and although this technology has been developed with reference to 
aircraft aerodynamic design in particular, the design space visualisation and 
curve-fitting technology developed is general. It should therefore be equally ^; 
applicable to other disciplines such as cost analysis/ structures and ; 
is computational electromagnetics, in which expensive analysis fools are used to • 
find optima for complicated design problems. It is expected, to be particularly 
useful in multi-disciplinary design and situations where there are multiple optima 
In the design space. 
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